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Abstract. We propose a model to study the coherence and entanglement resulting 
from the interaction of a finite-size atomic ensemble with degenerate counter- 
propagating field modes of a high-Q ring cavity. Our approach applies to an arbitrary 
number of atoms and includes the spatial variation of the field throughout the 
ensemble. We report several new interesting aspects of coherence and entangled 
behaviour that emerge when the size of the atomic ensemble is not taken to the 
thermodynamic limit of A — !■ oo. Under such conditions, it is found that the 
counter-propagating cavity modes, although in the thermodynamic limit are mutually 
incoherent and exhibit no one-photon interference, the modes can, however, be made 
mutually coherent and exhibit interference after interacting with a finite-size atomic 
ensemble. It is also found that the spatial redistribution of the atoms over a finite size 
results in nonorthogonality of the collective bosonic modes. This nonorthogonality 
leads to the super-bunching effect that the correlations of photons of the individual 
cavity modes and of different modes are stronger than those of a thermal field. We also 
investigate the spectral distributions of the logarithmic negativity and the variances 
of the output fields. These functions determine the entanglement properties of the 
output cavity fields and can be measured by a homodyne technique. We find that 
the entanglement is redistributed over several components of the spectrum and the 
finite-size effect is to concentrate the entanglement at the central component of the 
spectrum. 
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1. Introduction 

Generation of continuous variable entangled states with atomic ensembles coupled to a 
radiation field has been intensively discussed both theoretically and experimentally in 
recent years [IlEllHlllllSlEllTllH]. Atomic ensembles are macroscopic systems composed 
of a large number of atoms, and therefore it is a common practice in the theoretical 
treatments to work in the thermodynamic limit which takes the number of atoms 
N inside an ensemble to infinity, — ?■ oo. Under this approximation, the collective 
atomic operators are often represented, by using the Holstein-Primakoff representation 
of angular momentum operators [9], in terms of mutually independent bosonic modes, 
called collective bosonic modes. A large number of studies of a such system have been 
carried out in searching for superradiance and quantum phase transitions [lOl [TTl [12] . 
The atomic ensembles have also been used to demonstrate the deterministic creation 
of nonclassical light fields in the interaction of atoms with a cavity field. Cavities, 
in particular microwave and ring cavities, provide efficient and controllable setting for 
a strong interaction between macroscopic atomic ensembles and the electromagnetic 
field [131 El HSl [16]. For example. Parkins et al. [17] have demonstrated that atomic 
ensembles interacting collectively with laser fields inside a high-Q ring cavity can be 
unconditionally prepared in a two-mode squeezed state. The scheme, which is a 
generalization of the Guzman et al. [18] scheme to four-level atoms, is based on a suitable 
driving of the atomic ensembles with two external laser fields and coupling to a damped 
cavity mode that prepares the atoms in a pure squeezed (entangled) state. Similar 
schemes have been proposed to realize an effective Dicke model operating in the phase 
transition regime, to create a stationary subradiant state in an ultracold atomic gas [T9] . 
This approach has also been considered as a practical scheme to prepare trapped and 
cooled ions in pure entangled vibrational states [20] and to prepare four ensembles of 
hot atoms in pure entangled cluster states [211 [22]. Recently, Krauter et al. [23] have 
proposed to employ dissipation for generating a steady state entanglement between two 
distant atomic ensembles. 

Studies of macroscopic systems composed of atomic ensembles interacting with a 
cavity field do not have to be confined to the thermodynamic limit. It has recently been 
demonstrated experimentally that small atomic ensembles could serve as a resource 
for quantum metrology and quantum information science [211 [251 [23 [27]. This is the 
purpose of the present paper to consider a spatially extended finite-size atomic ensemble 
interacting with counter-propagating modes of a high-Q ring cavity. Special emphasis is 
given to identifying intrinsically finite-size effects. The approach adopted here is based 
on the solution of the master equation of an effective two-level system involving ground 
states of the four-level atoms forming the atomic ensemble. The approach has similarities 
with some previous treatments, except that we introduce a spatial dependence of the 
interaction of the cavity modes and the laser fields with the atoms. 

The spatial dependence arises naturally in the interaction of the fields with a finite- 
size atomic ensemble [281 129] , and the objective is to explore explicitly the issue of 
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size effects in creation of coherence and entanglement in continuous variable systems. 
Examples of coherence processes are given to illustrate the effect of a finite size of the 
atomic ensemble on creation of an entanglement between bosonic modes of the system. 
We find that the dynamics of the finite-size atomic ensemble differs qualitatively from 
those given in the thermodynamic limit. The inclusion of finite-size effects leads to a 
wide variety of unusual features. In particular, we find that collective bosonic modes of a 
finite-size atomic ensemble are not in general orthogonal to each other. In the course of 
the derivation of an effective Hamiltonian of the system, we observe that one of the finite- 
size effects is to create a direct coupling between the counter-propagating cavity modes. 
The mode nonorthogonality that couples the counter-propagating modes can drastically 
modify the property of the system. The important modification is that the coupling 
lifts the degeneracy of the cavity modes and leads to significantly different statistical 
properties of the modes. We present solutions for the second-order statistical moments 
of different modes of the system and find that the mode nonorthogonality gives rise to 
phase locking between the cavity counter-propagating modes, which leads to interesting 
first-order coherence effects. We also study the second-order correlation functions of 
the counter-propagating modes and show that the nonorthogonality leads to the super- 
bunching effect. In addition, we show that the nonorthogonality creates correlations that 
are necessary for entanglement between the intracavity modes. However, we find that the 
correlations created are not strong enough to produce and entangle between the cavity 
counter-propagating modes. We are therefore led to consider spectral distributions 
of the field variances and logarithmic negativity [301 El] fiiid that the two-mode 
squeezing and the entanglement can actually be created between spectral components 
of the output cavity fields. 

The paper is organized as follows. In section [2], we describe in more detail the 
cavity and atomic ensemble under consideration. We derive an effective Hamiltonian 
of the system and show that the major finite-size effect is in the nonorthogonality 
of the collective bosonic modes. We then apply the Hamiltonian to derive the 
Heisenberg equations of motion for the field operators, and solve them in terms of 
the Fourier transform variables. Section [3] is devoted for the study of the mode 
nonorthogonality on coherence and entanglement properties of the counter-propagating 
cavity modes. In particular, in sections 13.11 and 13.21 we analyze the first and second 
order coherence, respectively, between the counter-propagating cavity modes. We pay 
particular attention to the role of the mode nonorthogonality in the creation of coherence 
and correlations between the modes. Spectral distributions of the logarithmic negativity 
and the variances of the output fields are considered in section [3l3l where we illustrate the 
possibility of the creation of entanglement between spectral components of the output 
fields of the cavity modes. A summary of results is presented in section HI Finally, in 
the Appendix, we present analytical expressions for the steady-state mode occupation 
numbers, average amplitudes and correlations between the modes. 
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2. Atomic system and Hamiltonian 

The model we are considering is illustrated in Fig. [H It consists of an atomic ensemble 
located inside a high-Q ring cavity. The cavity field is composed of two degenerate 
in frequency and overlapped counter-propagating modes, called clockwise (R) and anti- 
clockwise (L) modes, characterized by equal frequencies ur = ul = Wc, and anti-parallel 
wave vectors fc^ = —ki = kc, respectively. The modes are represented by operators 
o-R {o-l) and a|j, {a\) which are, respectively, the annihilation and creation operators for 
the cavity clockwise (anti-clockwise) mode. 




Figure 1. A schematic diagram of a ring cavity containing an atomic ensemble 
trapped along the cavity axis. The clockwise and anti-clockwise cavity modes are 
damped with the same rate k. The driving laser fields are injected through one of the 
cavity mirrors and co-propagate with the clockwise cavity mode. The output cavity 
modes are mixed at a 50/50 beamsplitter and detected by two photodetectors. The 
output photocurrents are then registered by the coincidence counter CC. 

The atomic ensemble is composed of N identical four-level atoms interacting with 
external driving fields and a cavity field. An atom of the ensemble, say jth one, is 
represented by two non-degenerate ground states |0j), two non-degenerate excited 
states |sj), and its position r^-, as illustrated in Fig. [2l In practice such a four-level 
system could correspond to an F = 1 4-)- F' = 1 transition as occurs in *^Rb atoms. 

The cavity modes couple equally, i.e., with the same coupling strengths gji = gi = g, 
to atomic transitions |0j) — )■ \uj) and — j- \sj). This is acceptable since the degenerate 
overlapped cavity modes have the same polarization and geometry [131 El IIHj- In 
addition, the atomic ensemble is driven by pulse laser fields injected through one of 
the cavity mirrors and co-propagating with one of the cavity modes. The lasers are 
characterized by frequencies uis and uiu, wave vectors kis = ki^ = ki, and drive atomic 
transitions \0j) — t- \sj) and — )■ \uj), with Rabi frequencies Qg and Qu, respectively. 
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Figure 2. Energy level scheme of the atoms and coupling configurations of the 
laser fields and the cavity modes. The laser fields of the Rabi frequencies r2„ and fig 
drive the atomic transitions — )■ \uj) and |0j) — )■ \sj), respectively. The atomic 
transitions \lj) — > \sj) and |0j) — > \uj) are coupled to the cavity modes with the 
coupling strengths g„ = ~ g. 



The total Hamiltonian for the atoms and the cavity modes can be written as 

Ht = Hq + Hal + Hac, (1) 

where 

N 

Ho = hwc {o^RaR + a\ai}j + ^ {hwu\uj){uj\ 

+ nujs\sj){sj\ + nwi\i,;){ij\) (2) 

is the free Hamihonian of the cavity modes and the atoms, 

1 ^ 
i=i 

+ fi,e^(^'-"^^-'^'=*-'^^)|sj-)(Oj-| +H.C.} (3) 
is the interaction Hamihonian between the atoms and the driving fields, and 

N 

Hac = % 5^ { («i?e''"''^ + a^e-^^^-^^^) (0, | 
i=i 

W'^"^^ + aL^-'^^-'^^) \s,){l,\ + H.c.j (4) 



is the interaction Hamiltonian between the atoms and the two cavity modes. Here, 
(pu and (ps are phases of the laser fields, and oji.oJs and oju are atomic frequencies. 
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corresponding to transitions O |0j), \sj) ^ \0j), and \uj) O respectively. We 
have put zero energy at the ground state |0j). 

As we shall be interested in the generation of entanglement that requires minimal 
losses in the system, we consider an effective Hamiltonian in a dispersive regime that 
determines dynamics only between the ground states of the atoms. In this case, the 
cavity modes and the laser fields induce transitions between the ground states of the 
atoms via virtual transitions to far-off-resonant upper states. The effective Hamiltonian 
reads 



(4j_fc + al^J+fce-*'^'-) +H.C. 



+ 



(ay + ayi,) + H.c. 



(5) 



Vn 

Detailed derivation of the effective Hamiltonian together with the definitions of the 
parameters involved is presented in Appendix A. Note that the advantage of working 
in the dispersive limit of large detunings A.^ and A^ is to avoid spontaneous emission 
from the upper atomic states. In the derivation of (jS]), we have assumed further that 
the detunings A^ and A^ are much larger than the splitting of the ground states, i.e. 
Au, As ^ ui. This allows us to ignore decoherence of the ground states due to elastic 
Rayleigh scattering. Recently, Uys et al. [32] have demonstrated, both theoretically and 
experimentally, that in the case of the detunings A^ and A^ comparable to the splitting 
of the ground states may result in a considerable Rayleigh decoherence in the system. 

Among many parameters involved in the Hamiltonian (|5]), the most important for 
the purpose of the present paper is the parameter 

akO = Oik—^ (6) 

which stands for the strength of the direct coupling between the cavity modes. The 
coupling is caused by the spatial variation of the cavity modes that arises from the 
interaction of the modes with the finite-size atomic ensemble. The spatial variation is 
completely determined by the parameter a^, which is of the from 

1 ^ 
i=i 

This position dependent factor is recognized as the usual phase matching condition and 
represents an effective spread in phase difference between the cavity modes at fj. It 
follows that the factor will be different from zero when is not too large and fj are 
small. It is easy to establish that the factor vanishes in the thermodynamic limit of 
N oo. 

The Hamiltonian ([5]) describes the interaction of a collection of N two-level 
systems with the cavity counter-propagating modes. It involves linear interaction terms, 
proportional to as well as nonlinear interaction terms, proportional to (3s- Generally 
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speaking, there are three different types of virtual transitions in the atoms; one is due to 
absorption of a photon of frequency Uis from a pulse laser accompanied by the emission 
of a photon to either R or L cavity mode. This process takes the atom from the state 
\0j) to the state The second process is due to absorption of a photon of frequency 
coiu from a pulse laser accompanied by the emission of a photon to either cavity mode R 
or L. This process takes the atom from the state to the state \0j). Finally, the third 
process is due to absorption of a photon from either R oi L cavity mode accompanied 
by the emission of a photon of the same frequency to the counter-propagating mode. 
This process does not change the state of the atom. 

The later process is the most interesting, because it is related to finite-size effects 
and is not encountered at all under the thermodynamic limit of — )■ oo. It shows that, 
after the interaction with the finite-size atomic ensemble, there is generally mutual 
coherence between the cavity modes. The parameter ak5 characterizes the strength of 
the coupling between the cavity modes and expresses the coherent exchange of photons 
between the modes. This simply reflects the presence of a phase relation between 
the counter-propagating cavity modes. The efficiency of the coupling depends on the 
parameter at which, according to (JTj), is given by the phase mismatch of the propagation 
vectors of the cavity modes evaluated at the position of the individual atoms. The 
dependence of on the phase mismatch factor k^ — ki = ±2kc indicates that for a given 
cavity mode, the other mode can be viewed as a 'phase-conjugate' field of the mode. 
The coupling happens because the counter-propagating cavity modes force an atom 
to move in the opposite directions. Since for a finite-size ensemble the force depends 
on the position of the atom, it creates a potential energy between atoms located at 
different positions. The energy averages to zero in the limit oi N ^ oo due to a random 
redistribution of the atoms inside the atomic ensemble. 

Another interesting feature of a finite-size of the atomic ensemble is in the 
spatial dependence of the interaction between the atoms and the cavity fields that the 
multi-atom operators J±k, J^^. and do not satisfy the standard angular momentum 
commutation relations. The reason is in the presence of the phase factors exp[i{ki ± 
kc) ■ Tj], which arise from the phase mismatch between the propagation direction of 
the cavity modes and directions of the laser fields. These factors represent an effective 
spread in phase difference between the laser and cavity fields at fj. As a consequence, 
the interaction is affected in a different way than the cavity modes. Moreover, the 
presence of two different phase mismatch factors indicates that the atomic ensemble 
may be coupled to the cavity modes in two distinctly different ways. 

In order to explore this feature more explicitly, we adopt the Holstein-Primakoff 
representation of angular momentum operators [9], in which the two collective atomic 
operators, J±k, are expressed in terms of annihilation operators C±k of the corresponding 
bosonic modes as follows: 



N 





(8) 
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where 

1 ^ 

are collective bosonic operators with the annihilation bj and creation operators 
obeying the standard bosonic commutation relation = Sji. It is easily verified 

that the collective bosonic operators do not in general commute, i.e. 

C^k,C^ =afce±^*-. (10) 

Again, the reason is in the presence of the position dependent phase factors. Hence, the 
collective modes of a finite-size atomic ensemble are not orthogonal to each other. The 
degree of nonorthogonality of the modes is determined by the phase matching parameter 
tt/c, and the modes become orthogonal in the thermodynamic limit of — oo. 

The commutation relation can also be viewed as a non-distinguishability criterion 
for the collective modes. In the thermodynamic limit, = 0, and then the modes 
are completely distinguishable. For ak 7^ 0, the modes are partly distinguishable 
and become completely indistinguishable when = 1. As we shall see below, the 
non-orthogonality and thus indistinguishability of the modes will result in correlations 
between different modes of the system. 

Before proceeding further, we note here that the bosonic representation of the 
collective atomic operators of a finite-size atomic ensemble places no restriction on 
the number of atoms composing the ensemble [33]. The representation is valid for an 
arbitrarily small number of atoms with the condition of a very low excitation probability 
of each atom, i.e. (crji) ^ 1, where ali = 

The effective Hamiltonian ([5]) expressed in terms of the collective bosonic operators 
describes the interaction of a "fictitious" bosonic system with the two-mode cavity field, 
and has the form 

He = hw (^a^j^cLfi + a^a^j + hakS ^a^a/, -|- a'j^ajij 
+ huJoJ, + h/3u [a^nC~k + al^C'+fee"*'^^) + H.c. 

+ [hPs {a^nCle^^- + a^Cl,) + H.c] . (11) 

Note that the Hamiltonian is symmetric under reversal of the direction of propagation 
of either the laser field or the cavity mode. 

Instead of working with the collective operators C±k, we shall find convenient to 
work with two operators 



d2 = , / . ( - e-'^^C+k ] , (12) 



V2(l-afc 

which are linear symmetric and antisymmetric superpositions of the bosonic collective 
operators, respectively. It is easily checked that the superposition operators are 
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orthogonal to each other and obey the standard bosonic commutation relations, 
[di, dj] = and [di, dj] = 6ij. In terms of the superposition operators f|T2l) . the effective 
Hamiltonian (|TT|) simplifies to 

He = h{u + akS) a\di + h{u — akS) a\a2 

+ hwo (^d[di + dld2^ + 2h\i di^dix + 2/1A2 d2yd2y, (13) 
where Ai = /3^/TT~ak, ^2 = /S^l - "fc: = f^s = /?«), and 

di + d\] i (dl — (12] ^ [di+d\] ^ i (d^ — d2 



dix , d2y -y= , dix -j= , d2y -j= , (14) 

are in-phase and out-of-phase quadrature components of the cavity modes and the 
bosonic field operators, with 

= = (15) 

It is seen from f lT3|) that one of the finite-size effects on the system is to lift 
the degeneracy of the cavity modes by creating linear symmetric and antisymmetric 
superpositions of the modes with frequencies u + ak5 and u — a^^, respectively. It is 
also seen that the superposition collective modes are degenerate in frequency, but they 
do not behave similarly. The modes couple to the cavity superposition modes with 
different coupling strengths. The symmetric mode di couples to the cavity mode di 
with an enhanced coupling strength Ai = /3a/1 + Ofc, whereas the antisymmetric mode 
d2 couples to the mode 62 with a reduced strength A2 = P^/l — a^- It is interesting 
to note that the pairs of modes {di.di) and (a2,(i2) are decoupled from each other. 
This means that each pair can be independently prepared in a desired state. While the 
cavity superposition modes result from the hnear coupling between the cavity counter- 
propagating modes, the collective bosonic modes couple to the cavity modes in linear as 
well as in a nonlinear way. This is the nonlinear coupling that may create entanglement 
between the cavity and the collective bosonic modes. 

In the physical terms, the Hamiltonian f|T3|) contains terms describing four-wave 
mixing of the up-shifted (signal) and down-shifted (idler) cavity modes with the 
degenerate collective modes. Other terms proportional to the products of creation 
and annihilation operators for the same mode result in a dispersive effect. There are 
also terms that couple creation and annihilation operators of the cavity modes with 
the creation and annihilation operators of the collective modes. This interaction is 
responsible for the back-action evading nature of quantum non-demolition detection. 

It is worthwhile noting that, in spite of the fact that the finite-size feature of the 
system is manifested by the presence of three phase mismatch factors, the difference 
between the Hamiltonians of finite- and infinite-size atomic ensembles is embodied in a 
single parameter a^. In other words, the dynamics of the system are independent of the 
direction of propagation of the laser fields. They depend solely on the phase mismatch 
of the cavity counter-propagating modes. It is only the presence of that pulls of the 
degenerate cavity modes above and below their resonance by equal amounts, 5c, and 
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introduces an asymmetry to the coupling constants of the collective bosonic modes to 
the cavity modes. 

Before moving on to the consideration of coherence and correlation features in the 
system, we first briefly comment about the threshold behaviour of the Hamiltonian ( IT3|l . 
One can notice that the Hamiltonian ( fT3l) is of the form of two independent one-mode 
Dicke models 

He = Hi + H,, (16) 

where 

Hi = h^lia\ai + huJod\di + 2hXi di^dix, 

H2 = Kl2a\d2 + huodld2 + 2/iA2 d2yd2y. (17) 

with VLi = uj + and 0.2 = ^ — ^fc^- Hence, many features predicted previously by 
other authors for the one-mode Dicke model in the thermodynamic limit can also be 
seen in our model [101 HZJ [18] . However, instead of focusing on these one- mode features, 
we prefer to specialize our considerations to novel features of the two-mode Dicke model 
that might be brought by finite-size effects. For example, there might be coherence 
and correlations existing between modes that are simultaneously involved in both Dicke 
models. We examine these properties shortly, but first we examine a manifestation of 
the finite-size effects in the threshold behaviour of the system. It is easy to see that in 
the case of 7^ 0, the coupling strength Ai 7^ A2. As a consequence, there are two 
rather than one critical values of /3: 

2 VI + ak V "1 

/3c2 = ^ i — J^{^' + ni). (18) 

Thus, an interesting notable feature of the finite-size effects is the existence of two 
distinctive critical values of the coupling strength /3. It is easily verified that the critical 
values Pel and /3c2 shift in opposite directions as increases. Note that in the limit of 
ttfc — >■ 1, f3ci approaches a finite value, whereas /3c2 goes to infinity. 

The existence of the two threshold values for P indicates that the properties of 
the system could be different for different values of /3. It what follows, we confine our 
considerations to the case of below the thresholds, i.e. (3 < /3ci. 

3. Coherence and entanglement induced by the finite-size effects 

We now proceed to discuss the coherence and correlation features of the cavity modes 
brought by the finite-size effects of the atomic ensemble. As we have already mentioned, 
coherence and correlations can be created between different modes of the system. Here, 
we confine ourselves to the study of the coherence and correlations of the cavity counter- 
propagating modes only. The reason is that properties of the cavity modes can be 
directly measured by detecting of the out-put cavity fields. The coherence properties of 
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the other modes of the system can be found from the properties of the out-put cavity 
fields. 

In order to keep the considerations close to practical situations, we include a possible 
loss of cavity photons due to the damping of the cavity mode. With the cavity damping 
included, the state of the system is a statistical mixture determined by the density 
operator p whose time evolution is governed by the master equation 

2 



P 



OjCljP 



(19) 



where He is given in (1131) and k, is the cavity damping rate. This is the only damping 
we consider here as we have already eliminated spontaneous emission from the atoms 
by choosing large detunings of the driving lasers and the cavity modes. 

Our treatment is based on the solution of the Heisenberg equations of motion for 
the mode operators that are readily obtained from the master equation f|T9l) . and are 
given by 

d,j{t) = - i[aj{t), He] - Kaj{t) + V2Kaf{t), 

'd,{t)= -z[dj{t),He], J = 1,2, (20) 

along with the corresponding equations for the adjoint operators. In these equations, 
the operator d*"(t) describes the quantum noise injected at the cavity input. 

It is easy to show that the set of differential equations for the mode operators splits 
into two independent sets, each composed of four coupled differential equations. The 
sets of the differential equations are conveniently solved by taking the Fourier transform 
of the operators 



/27r 
1 

/2^ 



u{t)dt, 



■oo 
oo 



r'u\t)dt, 



(21) 
(22) 



where u denotes any one of the operators di, 02, (ii, (^2 and d™,d?," 



<,2 . Expressed as 

equations for the transforms of the operators, the solution for the mode operators may 
be written as 



d,(u) 



a2(z/) 



Ai 



a 



-v] 



A, 



Wo 



4(- 



(z/ - Uq) 

Mn(z/)dr(z/) + Mi2(z/)dr^(-t^) 

M2l(z/)4"(Z/) - M22(t^)4"^(-Z/) 



(23) 
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where 

Dj{u) = [k- i{v - - i{v + rij)](z/^ - ul) + 4A^wo^j, 

Mji(z/) = \/2k{[k - i{ij + VLj)]{ij'^ - ul) - 2i\]ujQ] , 

M^2{y) = -1i^\]uQ, J = 1, 2. (24) 

The frequency dependent solution ( 1231) will be used for the calculations of the collective 
modes and the field correlation functions necessary for evaluation of the two-mode 
squeezing and entanglement spectra. 

Since we are also interested in the steady-state coherence between the modes, we 
transform the solutions (l23l) back to the time domain and take the steady-state limit. 
Then all the functions necessary for the explicit calculation of the coherence are obtained 
by the average over the initial vacuum state with zero occupation numbers for all the 
modes of the system. The steady-state solution for the field averages and correlation 
functions are listed in the Appendix B. 



3.1. First-order coherence of the cavity modes 

First, we consider the first-order mutual coherence between the counter-propagating 
cavity modes. The mutual coherence between the cavity modes and a^, is measured 
by the cross correlation (a}^aL): the so-called coherence function, where the average is 
taken over the initial vacuum state of the modes [31] . The degree of coherence between 
the modes is given by 

L, I - 1(4"^) I 

\1{R,L)\ - I . . • I25j 

The visibility V of the interference pattern, on the other hand, is given by 
_ 2\{a\aL)\ 

The degree of coherence and the visibility of the stationary cavity fields can be readily 
calculated using the steady-state solutions fIB.ip . Since 

(a|ja/j) = = ^ + (4o2)) , (27) 

we see that the visibility equals to the degree of coherence independent of the parameters 
of the system. Moreover, 



where 



with 



(aj^oi,) = ^ (^{a\ai) - (4«2) j = akU{u, k), (28) 

rr/ N Wi{alw2W3 + U2U-i) + Ui{UsW2 + U2W3) 



Ml = (w — alS) , U2 = a\5'^ + -[- w^. 
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wi = 0^{ijj — 5), W2 = 2ujS, W3 = A(3'^{ijj + 5) — W2UJ0, 

Wi = 4:13^ {coo + 5)- 25ujI (30) 

We see that the coherence function depends directly on the finite-size parameter a^- 
This imphes that the cavity modes are correlated only when ak 7^ 0. The mode 
nonorthogonality can transfer photons from one mode to the other. Thus, one of the 
aspects of finite-size effects is the creation of the first-order correlation between the 
cavity counter-propagating modes. This feature is not encountered at all under the 
thermodynamic limit of — 00. In physical terms, we may attribute the appearance 
of the coherence to the fact that the counter-propagating modes are unresolved at the 
atomic ensemble, that it is impossible to tell to which mode the photon was emitted. 




Figure 3. The steady-state degree of coherence |7(_r,l)| plotted as a function of 
the couphng strength (3 for ujq = lu = 1,S = O.Itt, k = 0.2, and different degrees 
of mode nonorthogonahty a^: ak = 0.1 (solid line), ak = 0.5 (dashed line), and 
ak = 0.8 (dashed-dotted line). In this and in all the following figures, the parameters 
are normalised to 5k (= 1). 

Figure [3] illustrates variation of the steady-state degree of coherence |7{_r,l)| with 
/3 for several different values of at- It is seen that after the interaction with the 
finite size atomic ensemble, there is a non-zero mutual coherence between the counter- 
propagating cavity modes. The coherence increases with ak and the modes become 
perfectly correlated, |7(r,l)| — ?■ 1 as tends towards unity. Moreover, the coherence 
becomes less sensitive to (3 as increases. In addition, for ~ 1 the coherence attains 
its maximal value of |7(_r,l)| = 1 independent of (3. Notice, that the threshold value of 
the coupling strength at which |7(_r,l)| approaches unity, shifts towards smaller /3 as 
increases. The threshold value of P corresponds to a critical value of (3. 
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We close this section by evaluating the degree of coherence in the case of = 1, that 
is, when the size of the atomic ensemble is much smaller than the resonant wavelength 
of the cavity modes, i.e., when 2kc-rj ^ 1. To consider that limit, we can return to the 
effective Hamiltonian and note that with increasing to the value unity, the collective 
mode d2 becomes decoupled from the cavity field mode a2- In this case, the effective 
Hamiltonian reduces to that of a single-mode Dicke system involving only the field mode 
ai and the collective mode di. The modes ai and di undergo the time evolution, whereas 
the modes 02 and ^2 remain constant in time that they retain their initial values for 
all times. Although the behaviours of the system effectively as a single-mode Dicke 
system, it, in fact, involves two modes since the mode ai is a superposition of the cavity 
counter-propagating modes. 

The steady-state solutions ( ]B.1|) are not valid for = 1. However, almost all mode 
correlation functions can be obtained from ( IB. II) by putting A2 = except of {d\d2) and 
{d\d2)- These two correlation functions are constants of motion when = 1. As a 
result, the modes do not evolve in time, they retain their initial values for all times t. 
Thus, if initially the modes were unpopulated, they will stay unpopulated for all times. 
This somewhat unusual result is a consequence of the fact that the modes are totally 
decoupled from the applied field. The immediate consequence of the decoupling of the 
modes 62 and ^2 from the field is the appearance of the perfect correlation between 
the cavity counter-propagating modes. It is easy seen from ( 1271) and ( l29l) that in this 
case, the degree of the first-order coherence |7(_r,l)| = 1 irrespective of the parameters 
involved. This result has a simple interpretation, the mode di that can be prepared 
in an arbitrary state, is a linear superposition of the cavity counter-propagating modes 
that enter with equal weights. Therefore, both modes are always equally prepared, so 
that cannot be resolved, which is reflected in the coherence equal to unity. 

3.2. Second-order coherence of the cavity modes 

We now consider the second-order correlation functions of the fields of individual modes 
and of two different modes. We are particularly interested in the correlations in 
the cavity counter-propagating modes, represented by the operators or and di, and 
between these modes. The correlations are determined by {d^^d^^dRdji), (a|^a|^aLaL), 
and id}^d\dFidL) , respectively. More specifically, correlation functions describe the 
photon statistics of the field of the individual modes, and the cross correlations between 
photons from two different modes. As we shall see below, the second-order correlation 
functions, especially the cross correlation function {d^Rd^dndi) can be used to determine 
nonclassical effects and entanglement between the modes [351 136] . 

We shall consider normalized correlation functions and assume that the cavity 
modes are Gaussian-state modes that they obey the moment-factorization rules of a 
Gaussian random variable [37]. This is to be expected, since the collective bosonic 
modes are the sum of a large but finite number of atoms A^, whose fluctuations have 
been supposed to be statistically independent. Therefore, the Gaussian form of the 
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collective bosonic modes is expected to be reflected in a Gaussian form of the other 
modes. With this condition, the normalized second-order correlation functions can be 
written as 

(2) - 9 _J. |2 

9rr - — ^ \9 - ^ + \V[R,R) I , 



9'lI = 'T":\7' =2+h(L.L)| 

(2) \<^rO'L^R<^LI . , I |2 I |2 , . 



__(2) _ (QrqIqrQl) . , I |2 , I |2 

(alja/?)(aL^i) 

where |7(_r,l)| is the degree of the first-order coherence, defined in equation fl2S]) . and 

{aRaR)\ \{a{) + {al)\ 



\'n(L,L)\ = \^(R,R)\ 



{a^RCiR) (a|ai) (4«2)' 



I I \{aRaL)\ \{al) - (a')! /^^x 

are degrees of the so-called "anomalous" coherence [381 [39l HO], HH |12] . We see that the 
most important contribution to the second-order correlation functions comes from the 

(2") (2") 

anomalous coherence functions. These relations also show that g)^j^ > 2 and g\^l > 2, 
which means that photons emitted in the same direction, R or L, are always strongly 
correlated. This is a reflection of the Gaussian statistics of the cavity modes that the 
four-order moments {a^j^a^j^aRCiR) and (a^al^aia^,) factorize into \{aRaR)f +2{a^j^aRy and 
KolOl)!^ + 2(a^aL)^, respectively. No such factorisation is possible for a non-Gaussian 
statistics of the modes that may result in photon antibunching effect ^31 HU HSj HEl HT] 
of^?l<lor ^S<1. 

The inter-mode second-order correlation function is the sum of contributions 
|7(R,L)P and |77(i?,L)p5 which indicates that the correlation of photons emitted in opposite 
directions depends on two kinds of coherence, the mutual first-order coherence and 
mutual anomalous coherence. 

Let us examine the dependence of the correlation functions on the ensemble size 
parameter a^. For purposes of an explicit analytical analysis, it is somewhat more 
convenient to rewrite (125|) in terms of the superposition cavity modes 1 and 2. With 
the help of ( lT5l) . we arrive at the expressions 

{a[ai) - (a^as) 

|7(R,L)| = ,.t- \ ^ /-t- \ • 
{a[ai) + (0202) 

We observe that the inter-mode coherence function |7(_r,l)| depends on the difference 
between the number of photons in the superposition modes, whereas the inter-mode 
coherence function |?7{_r,l)| depends on the difference between the anomalous coherence 
functions of the modes. Thus, some kind of asymmetry between the superposition modes 
is needed to create the coherence between the cavity counter-propagating modes. The 
coherence ( 15^ and (15^ can be readily evaluated using the steady-state solutions (IB.ip . 



Finite-size atomic ensemble in a ring cavity 



16 



Consider first the correlation functions in tlie tfiermodynamic limit, in which case 
Ofc = 0. From the steady-state solutions, fIB.ll) . it follows that in the limit of = 0, 

(ajdi) = (02^2), (^i) = "(^2), and \{a1)\ = {a\ai), so that 

\ViR,R) \ = \ViL,L)\ = \l{R,L)\ = 0, |'7{i?,L)| = 1, (34) 

and from (I3T]) . we immediately obtain that 

9Si = 9?l = 2, and ^gl = 2. (35) 

These results show that in the thermodynamic limit the cavity modes and the correlation 
between the modes exhibit correlations characteristic of a thermal field. It is, of course, 
a reflection of the fact that the system operates below the threshold where the modes 
are in thermal states. This is the kind of behavior that is expected for the cavity 
modes. One could argue that the same circumstances apply for the presence of the 
correlations between the modes. However, the circumstances for the second-order 
correlations f?)^^ = 2 are different. The source of the correlation between the modes 
is not in the thermal fluctuations, as it takes place in the well-known Hanbury-Brown- 
Twiss effect, but is in the impossibility to distinguish from which mode each of the two 
photons came. This is represented by the anomalous coherence \r](^R^L)\, and for this 
reason, we could call this effect as an anomalous Hanbury-Brown-Twiss effect. 

We have already seen that in the thermodynamic limit only the mutual anomalous 
coherence |?7(_r,l)| is different from zero and, in fact, attains its maximal value of unity. 
It is clear by inspection of ( 132|) that an asymmetry between the superposition modes is 
required to get all of the coherence different from zero. It is easily verified from (IB. Ill 
that the required asymmetry is provided by the ensemble size parameter a^. In this 
case, the second-order correlations can be larger than that for the thermal field. This 
is known in the literature as a super-bunching effect [HI SHI EHl Elj- Hence, «fc ^ 
is the general condition for the super-bunching effect. The variation of the correlation 
functions with Ok for several different values of /3 is illustrated in figure HI It is evident 
that the finite-size effects enhance the correlations between photons emitted in the same 
as well as in the opposite directions. 

The largest value of the correlations is achieved when at = 1, in this case 
9rr ~ 9ll ~ 9rl ~ 3- This value is the border value between classical and nonclassical 
Gaussian states jlHl [52]. We may conclude that the output cavity modes behaviour 
as an unusual classically correlated reservoir which exhibits strong classical correlations 
simultaneously inside the individual modes and also between the modes. Typical sources 
of correlated beams, such as optical parametric oscillators exhibit correlations stronger 
than that of a thermal field only between the modes. 

One can also notice from the figure H] that the correlations functions g}^!^ and g\^l 

(2) 

behaviour similarly to the mutual correlation function gj^[. However, there is a relation 
between the correlation functions, given by the Cauchy-Schwartz inequality 



(2) (2) 

XRL = > 1, (36) 

9^rI 
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Figure 4. The stationary second-order correlation functions g\f'^ (left frame) and g\^\^ 
(right frame) plotted as a function of the finite-size parameter ol^ for wq = w = 1, 5 = 
O.Itt, K = 0.2, and different values of the coupling strength p-. P = 0.1 (solid line), 
/? = 0.2 (dashed line), and /3 = 0.3 (dashed-dotted line). 



which says that the cross correlations between photons from the two different cavity 
modes are smaller than the correlation between photons of the individual modes. An 
interesting question arises whether the Cauchy-Schwartz inequality can be violated in 
the system. 
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1.008 - 



1.006 



1.004 - 



1.002 - 



1.000 




a 



Figure 5. Variation of the Cauchy-Schwartz parameter xrl with the finite-size 
parameter a^. for wq = a; = 1,(5 = O.Itt, k, = 0.2, and different values of the coupling 
strength (3: (i = 0.1 (sohd line), (3 = 0.2 (dashed line), and /? = 0.3 (dashed-dotted 
line) . 
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Figure O illustrates the variation of the Cauchy-Schwartz parameter xrl with a^- 

(2) (2) 

We see that even when the correlations functions g^^^ and gj^l behaviour similar to the 
mutual correlation function gj^[, the Cauchy-Schwartz parameter varies with a^. It is 
apparent that xbl is always more than or equal to unity for all a^, with equality at 
ak = and = 1, indicating that the Cauchy-Schwartz inequality is not violated. 
Thus, the finite-size effects create strong correlations between the cavity modes but do 
not allow the relation fl36|) to be violated. 

It is not difficult to show from ( l3Ti) and ( l32l) that the inequality ( l36l) is equivalent 
to the inequality |'7(i?,,L)| < 1, that for the Cauchy-Schwartz inequality to be satisfied, 
the mutual anomalous coherence must be smaller than unity. Thus, for a violation of 
the Cauchy-Schwartz inequality it is necessary that the degree of the mutual anomalous 
coherence to be larger than unity. It is worth noting that such values can be achieved 
only by a quantum field [SI [53l [36] . 




0.20 




a. 
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Figure 6. Variation of the Cauchy-Schwartz parameters xii (left frame) and X22 
(right frame) with the finite-size parameter ak for loq = lu ^ 1,S = O.Itt, k = 0.2, and 
different values of the couphng strength /3: /3 = 0.1 (sohd hne), (3 ~ 0.2 (dashed Une), 
and /3 = 0.3 (dashed-dotted hne). 



Although the Cauchy-Schwartz inequality is not violated between the cavity modes, 
it may be violated between other modes. Figure [6] shows Cauchy-Schwarz parameters 
Xii and X22 defined as 

{d\d\didi)'^ (a'2'^2^2C^2)^ 
which provide measures of the second-order correlations between photons from two 
superposition modes {di and di), and from other two superposition modes (02 and ^2), 
respectively. The correlations are said to violate the Cauchy-Schwartz inequality if 
Xii {i = 1, 2) is smaller than unity. It is seen that the Cauchy-Schwartz inequality is 
violated for both pairs of the modes indicating a strong nonclassical correlation between 
the superposition modes. These violations exist even for = and decrease with 
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increasing pumping strength /3. The physical reason for the violation of the Cauchy- 
Schwartz inequality can be traced to nonlinear processes that are known to produce 
quantum effects in the interaction between bosonic modes [M]- It is evident from 
the effective Hamiltonian (fT3|) that such processes exist in the system. There is a 



of these nonlinear couplings is to produce nonzero anomalous correlation functions that 
are responsible for enhanced inter-mode correlations. 

In summary of this section, we have found that the role played by the finite-size 
effects in the second-order correlations is principally to create correlations which are 
larger than that achievable with thermal fields. However, there is a limitation on the 
values of the second-order correlations that could be created by the finite-size effects. 
The second-order correlation functions vary with the finite-size parameter ak from 

(2) (2) 

glj = 2 for afc = to the maximum of g^j = 3 for = 1, which is achieved when 
the dimensions of the atomic ensemble are much smaller that the resonant wavelength. 
These results show that the total field emerging from the cavity is a classical but strongly 
correlated thermal field. It was found that quantum effects such as the violation 
of the Cauchy-Schwartz inequality can be created between the superposition modes. 
Unfortunately, the quite large violations of the Cauchy-Schwartz inequality for the 
superposition modes do not lead to violation of the Cauchy-Schwartz inequality for 
the correlations between the cavity counter-propagating modes. 

3.3. Entanglement and two-mode squeezing spectra of the output cavity modes 

Since the finite-size effects create first-order coherence and the second-order correlations 
between the modes, there actually could be two-mode squeezing and entanglement 
between the modes associated with a nonlinear coupling between the modes as well. An 
inspection of the effective Hamiltonian (fT3|) reveals that a nonlinear coupling actually 
exists only between modes di and di, and between modes 0,2 and ^2- Thus, the modes 
{di,di) and (02,(^2) could be entangled between themselves. This suggests that the 
other pairs of the modes cannot be entangled. We now examine the possibility to create 
two-mode squeezing and entanglement between the cavity counter-propagating modes 
and a^j and how these effects could depend on the finite-size parameter a^. 
In order to find if entanglement and two-mode squeezing can be created between the 
cavity modes and ai modes, we introduce the position and momentum operators for 
the annihilation operators of the superposition modes, di and 02, which can be defined 
as 



where 6 is the quadrature phase. 

To see if an entanglement exists between the cavity counter-propagating modes, 
and ttL, we use a condition based on the two-mode squeezing, proposed by van Loock 



nonlinear coupling between modes di and di, and between modes 02 and d2. The effect 





(38) 
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and Furusawa By use of the mode transformations for the modes a^, ai, and 
0'2i f|T5l) . the sufficient condition for the entanglement between the two cavity modes 
and aL is of the form [55] 



with ipj = arctan(fi:/a;j). Here, the double colon :: stands for the normal ordering of the 
operators. 

When we evaluate the normally ordered variances fHOj) using the steady state 
solutions (!RT|1 . we then easily find that (: (AXf)^ :) + (: {AP^Y :) > for any 9. 
Thus, there is no squeezing between the cavity modes. Equivalently, the cavity modes 
are separable. We may conclude that any measurable criterion predicts no squeezing 
and thus no entanglement of the total field of the counter-propagating cavity modes ai 
and qr. On the other hand, from fl28l) and fl32l) . we see that (cl^jiCLl) ^ 0, and {anaLj ^ 
when ak 7^ 0. This means that the modes are correlated and the strength of correlation 
depends on the values of a^. Hence, the modes are correlated but not strong enough 
to be squeezed (entangled). This conclusion agrees with our previous findings that 
the modes are correlated to the degree of g]^l = 3, which is the border value between 
classical and nonclassical Gaussian states. This means that the correlations created in 
the pairs (ai, di) and (027 (^2) can be transferred to the cavity modes, but are not strong 
enough to entangle the modes. 

We stress that the calculated correlations corresponded to that of the total cavity 
field. It is well known that in some situations there is no squeezing in the total field, 
but there could be squeezing between spectral components of the field [561 EZ]- In 
other words, the question of whether the total output field is squeezed (entangled) may 
be irrelevant to the problem of obtaining large amount of squeezing (entanglement) at 
some particular spectral frequency. Nevertheless, we shall show that a strong squeezing 
(entanglement) exists between spectral components of the output cavity fields. 

We now use the frequency dependent solutions for the cavity modes and the 
relations between the input and output fields [58] 



We shall use the frequency dependent operators to calculate the measurable spectra 
of the output fields transmitted by one of the cavity mirror with decay constant k. 
Let u is the frequency of the output clockwise (i?) mode and z/' is the frequency of the 
output anti-clockwise (L) mode. We may introduce finite frequency intervals 5z/ and Su' 
defined as 




(39) 



where the normally ordered variances are given by 




(40) 




61^ = ^1 — u, 5u' = —uji + u\ 



(42) 
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such that at = du' the modes are symmetrically located about 2c<j;, i.e. z/ + z/' = 2uji. 
We consider spectral distributions of the variances 

2 \ / / _ „ \ 2 



V 



AP^{u') : ) = S{u, e)6{2ui -u-u'), (43) 



where Xf(z/) and are Fourier transforms of the quadrature phase operators of 

the superpositions di and 0.2 of the output modes, defined as 



-out I 



\ iO I ~out\ / \ 



-ie 



-out'l I 



-z/')e 



(44) 



We also consider the spectral distribution of the logarithmic negativity criterion 
that is known as the necessary and sufficient condition for entanglement of two-mode 
Gaussian states [591 EOl 



E„(z/) = max{0, -log2 [2Vs{iy)]} , (45) 

where K(^) is the smallest sympletic eigenvalue of the partially transposed covariance 
matrix of the output field. We shall compare the criterion with the two-mode squeezing 
criterion to quantify squeezing as an alternative necessary and sufficient condition 
for entanglement [61]. The advantage of the two- mode squeezing criterion over the 
negativity is that the former can be directly measured in experiments whereas the later 
can be inferred from the reconstruction of the density matrix of the system. 

To evaluate £'„(i^), that describe entanglement of a two-mode output Gaussian 
state, we use Wigner characteristic function 



aL, 



exp ( --^V{u)^ 



T 



(46) 



where ^ = (iCIfli CaH, Cli' ^^l) a vector of complex variables, is the transposed for 
of C,, and V{i>) is the covariance matrix of the form 

/ fiiiy) f2{v) Uv) U{v) \ 

/K^) /l(^) /4*(^) /3(^) 

fA{y) h{y) f2{y) 

\ m^) fsi^) /i(^) /i(^) / 



V{u) 



(47) 



with 



1 _ 

2 ~ ^^R v^;?"/? ;/ — v^-l 
"M*2(z/)Mi2(z/0 M*2(z/)A'/22(i^' 
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(48) 



>5{2uJi — u — u'). 



This shows that f2{^), fz{^) and f^{i') determine the correlation between the two output 
cavity modes. 




Figure 7. The variation of the logarithmic negativity En{v) and the variances S{v^ 0) 
with the frequency interval 5v = uji — u for wq = cj = l,i5 = O.Itt,^ = 0.44, k = 0.2 
and several different values of at'- au = 0,0 ^ 1.6856 (sohd line), ak = 0.3, 9 = 1.6518 
(dashed line), = 0.5, 6 = 1.6676 (dotted line). The arrow indicates frequency of the 
generalized Rabi frequency /3. 

Having the covariance matrix, we may discuss in detail the establishment of 
entanglement between two output cavity modes. We shall be particularly interested 
in the role of the finite-size effects on the output entanglement of the two counter- 
propagating cavity modes. 

Figure [7] shows the spectral distribution of the logarithmic negativity and the 
variances of the output fields for different ak- We also vary the phase 9 due to varying 
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of the optimal squeezing with an increasing a^. First, we note that independent of a^, 
it is possible for S^u, 6) to be negative for some frequencies, so that S{u, 6) dips below 
the quantum limit at those frequencies, even though there is no two-mode squeezing 
in the total field. Moreover, we see that entanglement occurs for all frequencies and 
the maxima of entanglement correspond to the minima of the variances S{v, 9) and 
S{v,9 + vr/2). The maxima of entanglement occur at frequencies corresponding to the 
imaginary parts of the roots of the Djiy) polynomials. Note that the entanglement 
that lies in the range of low frequencies < 1) is attributed to squeezing in the 9 
quadrature component of the output field, S{u,9), whereas the entanglement that lies 
in the range of high frequencies > 1) is attributed to squeezing in the 9 + 71/2 
component S'(z/, 9 + 71/2). 
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Figure 8. The variation of the logarithmic negativity En(y) and the variances 5(1^, 0) 
with the frequency interval bv ^ uji — v for fixed ldq ^ l^j ~ = O.Itt, = 0.1, k = 0.2 
and several different values of ;3: ;3 = 0.4, 6* = 1.6958 (sohd hue), /3 = 0.46, Q = 1.6734 
(dashed line), /3 = 0.4932,61 = 1.7625 (dotted line). 

It is interesting to observe that the cavity modes can be entangled regardless of 
the size of the atomic ensemble. However, the frequency range at which the modes are 
entangled varies with the finite-size parameter 0;^, i.e., the modes can be entangled at 
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several different frequencies. When = 0, the logarithmic negativity and the variances 
can both have four peaks. When 7^ 0, the peaks merge towards = 0. In this case, 
two-mode squeezing occurs only in the 6 quadrature. It follows that with a finite- 
size ensemble, the largest entanglement is observable in principle at the frequency a);. 
Thus, the size effect is to concentrate the entanglement at the central component of the 
spectrum. In other words, an optimal degree of squeezing (entanglement) at = 
indicates that the output modes are correlated about the average laser frequency ui. 

Figure M illustrates how the pumping strength /3 alters spectral redistribution of 
two- mode squeezing and entanglement. Again, each curve is plotted with 6 optimized 
to give best squeezing. It can be seen that only the low frequency entanglement and 
two- mode squeezing {\u\ < 1) shifts towards the central frequency as /3 increases. 
Notice significant variations of the low frequency entanglement and squeezing with 
relatively small variations of (3. In contrast, the high frequency entanglement and 
squeezing are almost insensitive to /3. The effect of raising /3 causes only a slight 
shift of the peaks. Thus, the entanglement and two-mode squeezing associated with 
the 6 + 71/2 quadrature component are less sensitive to /3 than those associated with 
the 6 quadrature component. Nevertheless, this does not prevent us from achieving the 
largest entanglement at the cavity frequency. 

4. Conclusions 

We have shown that finite sizes of atomic ensembles coupled to counter-propagating 
modes of a high-Q cavity do have a non- negligible effect on coherence, correlations and 
entanglement between the cavity modes. In particular, we have shown that finite sizes of 
the atomic ensemble may result in nonorthogonality of the collective bosonic modes. We 
have found that the mode nonorthogonality can create the first-order coherence between 
the modes and appears as the transfer mechanism of the fluctuations between the 
superpositions of the cavity counter-propagating modes. We have shown that the mode 
nonorthogonality may result in the second-order correlations that are stronger than 
that of a thermal field. The correlations are manifested in the photon super-bunching 
effect. In addition, the nonorthogonality creates correlations between the modes that 
are necessary for two-mode squeezing and entanglement between the modes. However, 
we have found that the correlations created are not strong enough to violate the Cauchy- 
Schwartz inequality and to produce entanglement between the modes. Therefore, we 
have also considered the spectral distributions of the logarithmic negativity and the 
variances of the output cavity fields and have found that entanglement, although not 
present in the total field, can be created between spectral components of the output 
cavity fields. The effect of the mode nonorthogonality is to concentrate the entanglement 
at the central component of the spectrum. 
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Appendix A 

In this appendix we shall discuss in detail the derivation of the effective Hamiltonian (jS]). 
The method is based on the adiabatic elimination of the excited atomic states valid in 
the limit of large detunings of the laser fields and cavity mode frequencies from the 
atomic transition frequencies (dispersive regime). The method is well known in the 
literature and more details can be found in Refs [621 [63|, 

We shall derive an effective Hamiltonian in a dispersive regime of the interaction 
of the atoms with the cavity modes and external laser fields. Employing the unitary 
transformation U{t) = exp[—i{HQ/ h)t] to the total Hamiltonian ([T]), where Hq is given by 

N 

+ UJis\Sj){Sj\ +Ud\lj){lj\] , (A.l) 



we obtain 



where 



and 



in which 



H = U\t)HTU{t) = Ho + Hal + Hac, (A.2) 



Ho = U\t)HoU{t) = hA, (a^flR + a{aL 



N 

+ hJ2{^u\uj){uj\ + As\sj){sj\ + {ui-Ud) (A.3) 



Hal = U\t)HALU{t) 
1 ^ 

= -nJ]{fi„(r,-)|w,)(l,|+fi.(rS-)|s,)(0,-|+H.c.}, (A.4) 



Hac = U\t)HAcU{t) = hgY,[ (a^e*'^-^^^ + a^e"^^^-^^^) |m,)(0,| 

+ (an^^^^-''^ + CLLe-'^^-'"') |s,)(l,| + H.c.} , (A.5) 

n^{r^) = fi,e^(^^'-:'-<^-), n,{r,) = n,e'^^'-^^^-'^^\ (A.6) 
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(A.7) 



are detunings of the atomic transition frequencies and of the cavity frequency from the 
laser field frequencies, with 



1. N 1/ N 



(Ai 



standing for the average frequency and detuning between the laser frequencies, 
respectively. 

We may extract a part of the Hamiltonian Hq that involves the upper states of the 
atoms 

N 

H'^ = hY,{K\uj){uj\+ /\,\s,){s,\) , (A.9) 
and make a unitary transformation of the remaining part of the Hamiltonian H to obtain 

N 



N 



-^u{r,)\u,){l, \+g[ aRe'"^-'^ + a^e ^'^-"^^ ) \uj) (0, | 



+ 



-fi,(r-;-)|s,)(0,| + (7(aRe^'=-^^ +aie-*'=-'-^)|s,)(l, 



H.c.(A.lO) 



Consider now the time evolution operator for the time dependent Hamiltonian Hi[t) 

ft 1 ft ft' 

Uj{t) = l-'- / dt'Hiit') - 4 / dt'Hiit') / dfHiit") + ... (A. 11) 



h 



The first-order contribution is of the form 



f9 



dt'Hiit') = t j/iAe (aJjOR + d[dL) +hY,{coi- Ud) |l,)(lj|| 



N 

'1 



^s{rj)\sj){Oj\ + gidRe'"^-'^^ + a^e 



JAst 



As 



.(A. 12) 



in which the first term is linear in time and the other terms oscillate with detunings A„ 
and As, respectively. 

The second-order contribution can be written as 



f dt'Hj{t') f dt"Hj{t") 
Jo 
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+ 



N 

2 A, 



^^^^^ {ane''-''^ + aLe-'"-'^^ 



|o,)(i.l 



|1.)(0. 
-H.c. 



H.c. 



+ 



A 

1 \a 



|0,)(0,| 



4 A 



,2 1 io 



4 A. 



|0,)(0, 



+ . . . 



(A.13) 



where we extracted only terms that are hnear in time. 

If we assume that the detunings of the laser fields are much greater than the Rabi 
frequencies, the cavity coupling constants and the atomic spontaneous emission rates 

|A„|,|A,| >l]„,fi„^,7, (A.14) 

where 7 is the spontaneous emission rate of the excited states of the atoms, the 
oscillatory terms make a negligible contribution to the time evolution operator and, 
after discarding them, we obtain f//(t) 1 — itHe/h, where 



+ 



h(3. 



H.c. 



H.C. 



in which 



N 



N 



are position dependent collective atomic operators 



and 



UJo = UJi-Ud + 



(A.15) 



(A.16) 



(A.17) 



A ^ " ' 4A 

are detunings of the cavity field frequency and of the atomic frequency ui from the laser 
frequencies modified by the intensity-dependent Stark shifts, 

^gn^ ^ ^/Ngn, 



(3u 



f3s 



(A.18) 



2A ' 2A 
are the effective Rabi frequencies which quantify the strength of the coupling of the 
effective two-level system to the cavity modes due to virtual transitions to the highly 
detuned \uj) and \sj) states, and 

^Ng' 



o^kS = \ak\ 



A ' 



(A.19) 
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with 

1 ."^ 



1 ^ 

— ^e±2ifcc-r,. ^^20) 



In the derivation of Eq. flA.lSp . we have chosen = = A, which involves 
no loss of generality, and have redefined the cavity field operators that now read 
aji = aRexp{—i(f)N/2) and ql = exp(i0Ar/2). We have assumed further that the 
laser phases (pu = —4>s = <Pn/2, where the phase (pN is defined in ( ]A.20I) . It should 
also be noted here that the assumption of equal detunings of the laser fields and the 
cavity modes from the atomic upper states, as illustrated in Fig. [2l gives Ac = — Ud- 
However, due to the presence of the Stark shifts, this condition is modified to u = Uq. 



Appendix B 

Here, we present the steady-state solutions for the cavity and the collective bosonic 
modes occupation numbers, average amplitudes and correlations. We assume that all 
modes were initially in the vacuum state. In this appendix we present the steady-state 
solutions for the cavity and the collective bosonic modes occupation numbers, average 
amplitudes and correlations. We assume that all modes were initially in the vacuum 
state. 



with 



{a]aj) 
0%) 



Xj [{^j + m)(K2 + _ hj] 



2 



(^ ) = '\ , ' , (B.l) 
hj = uo{k^ + n]) - 4A^2^., J = 1, 2. (B.2) 
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